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Abstract — This paper proposes a new adaptive algorithm for 
the implementation of the linearly constrained minimum variance 
(LCMV) beamformer. The proposed algorithm utilizes the set- 
membership filtering (SMF) framework and the reduced-rank 
joint iterative optimization (JIO) scheme. We develop a stochastic 
gradient (SG) based algorithm for the beamformer design. An 
effective time-varying bound is employed in the proposed method 
to adjust the step sizes, avoid the misadjustment and the risk of 
overbounding or underbounding. Simulations are performed to 
show the improved performance of the proposed algorithm in 
comparison with existing full-rank and reduced-rank methods. 

I. Introduction 

Adaptive beamforming technology has received consid- 
erable attention for several decades and found widespread 
applications in radar, sonar and wireless communications [1]. 
The optimal linearly constrained minimum variance (LCMV) 
beamformer [21 which minimizes the array output power while 
maintaining the array response on the direction of the desired 
signal, is the most well-known beamformer However, the 
computation of the inverse of the received data covariance 
■ matrix and the requirement of the knowledge of the cross- 
correlation vector present difficulties for its implementation. 

A number of adaptive algorithms have been reported for the 
implementation of the LCMV beamformer ([T], (|3]. Among 
them the stochastic gradient (SG) algorithm f?!, fS] is popular 
> due to its simplicity and low complexity. The drawback of 
'the SG algorithm is that the convergence depends on the 
. eigenvalue spread of the received data covariance matrix. This 
condition could be worse when the number of elements in the 
. filter is large since it requires a large amount of snapshots to 
' reach the steady-state. 

Reduced-rank signal processing was introduced to provide 
a way out of this dilemma ir7l- lfT4l . The reduced-rank schemes 
project the received vector onto a lower dimensional subspace 
and perform the filter optimization within this subspace. The 
advantages are their fast convergence properties and enhanced 
tracking performance when compared with full-rank schemes 
operating with a large number of parameters in the filter for 
the beamformer design. The reduced-rank algorithms range 
from the auxiliary vector filtering (AVF) [8 |, the multistage 
Wiener filter (MSWF) |9|, to the joint iterative optimization 
(JIO) based works reported in llT3l . ||T41 . Despite the improved 
convergence and tracking performance achieved with the ex- 



isting reduced-rank methods, they have to afford the heavy 
computational load as a tradeoff. 

In this paper, we introduce a new LCMV reduced-rank 
algorithm based on the JIO scheme. The proposed algorithm 
employs the set-membership filtering (SMF) technique I16J . 
ifTTl to reduce the computational complexity significantly 
without the convergence speed reduction and the performance 
loss. The SMF specifies a bound on the magnitude of the es- 
timation error (or the array output) and uses the data- selective 
updates to adjust parameters according to this predetermined 
bound. It involves two steps: 1) information evaluation and 2) 
parameters adaptation. If the parameter update does not occur 
frequently, and the information evaluation does not require 
much complexity, the overall computational cost can be saved 
substantially. The current SMF algorithms (see [18] and the 
reference therein) pay attention to the full-rank parameter esti- 
mation. Considering the fact that the reduced-rank algorithms 
exhibit superior performance over the full-rank methods (0, 
1 14|, |T5l, it motivates the deployment of the SMF mechanism 
to the reduced-rank scheme to guarantee the good performance 
with low complexity. We employ the SMF technique with the 
reduced-rank JIO scheme for the LCMV beamformer design 
and develop the SG based algorithm for implementation. 
Compared with the work reported in llT6l . llTSl . the devised 
scheme consists of a bank of full-rank adaptive filters, which 
constitutes the projection matrix, and an adaptive reduced-rank 
filter that operates at the output of the bank of full-rank filters. 
It provides an iterative exchange of information between the 
projection matrix and the reduced-rank filter and thus leads to 
improved convergence and tracking performance. Compared 
with the JIO based method (with the fixed step sizes) in llT4ll . 
the proposed algorithm uses the SMF technique to adjust the 
step sizes for the updates of the projection matrix and the 
reduced-rank weight vector, and thus has an attractive tradeoff 
between the convergence rate and misadjustment. Furthermore, 
a time varying bound is incorporated in the proposed algorithm 
to avoid the risk of overbounding and underbounding in 
dynamic scenarios |18|, and to improve the performance with 
a small number of update. 

The remaining of this paper is organized as follows: we out- 
line a system model for beamforming and present the problem 
statement in Section 2. Section 3 derives the proposed adaptive 
reduced-rank algorithm. Simulation results are provided and 



discussed in Section 4, and conclusions are drawn in Section 
5. 

II. System Model and Problem Statement 

A. System Model 

Let us suppose that q narrowband signals impinge on a 
uniform linear array (ULA) of m (g < m) sensor elements. 
The sources are assumed to be in the far field with directions of 
arrival (DOAs) 6*0,. . . ,dq-i- The received vector x{i) G 
at the «th snapshot can be modeled as 



x{i) = A{e)s{i) + n{i) 



1, 



.,N 



(1) 



where 6 = [9a, . . . ,9g^if G W''^ is the DOAs, A(6») = 
[a{6o), ■ ■ ■ ,a{Oq-i)] G C™^^ composes the steering vec- 
tors aiOk) = [i,e-2-.'"^--«^,...,e-2"^('"-^)^™^''^]^ G 
C'"^^, (fc = 0, — 1), where Ac is the wavelength 

and d = Ac/2 is the inter-element distance of the ULA, and 
to avoid mathematical ambiguities, the steering vectors a{9k) 
are considered to be linearly independent. s{i) G C^^^ is the 
source data, n{i) G C™^^ is the white Gaussian noise, N 
is the observation size of snapshots, and (■)^ stands for the 
transpose. The output of a narrowband beamformer is 

y{i) = w"x{i), (2) 

where w = [wi, . . . ,Wm]^ G Qmxi j-j^g complex weight 
vector, and (•)^ stands for the Hermitian transpose. 

B. Problem Statement 

The optimal LCMV filter for beamforming can be computed 
by solving the following optimization problem 



minimize E[\w^x{i)\'^] 



subject to a 



1, 



(3) 



where a{9o) denotes the steering vector of the desired signal 
and 7 is a constant with respect to the constraint. The weight 
solution is 



w = 



(4) 



aH{9o)R-'a{0o)' 

where R = E[x{i)x^ (i)] G C™^™ is the received vector 
covariance matrix. The complexity of the weight computation 
is high due to the existence of the covariance matrix inverse 
in dUi. The SG algorithm [4] can be used to estimate w{i) 
with low complexity but suffers from the slow convergence, 
especially when the array size is large. 

The most important feature of the reduced-rank algorithms 
is to perform the dimensionality reduction and retain the key 
information of the original signal in the reduced-rank received 
vector, which is 

x{i) = T^x{i), (5) 

where Tr £ C™^"^ denotes the projection matrix that is struc- 
tured as a bank of r full-rank filters tj — [ti.j, . . . , t^.j]'^ G 
C™^^, (j = 1, . . . , r), r is the rank number, and x{i) G 
is the reduced-rank received vector In what follows, all r- 
dimensional quantities are denoted by an over bar. An adaptive 



reduced-rank filter w = [wi, . . 
produce the output 



.,Wr 



G 



y{i) — w^x{i). 



is followed to 



(6) 



The main concern left to us is how to effectively design 
and calculate the projection matrix. The popular reduced- 
rank schemes include AVF [8|, MSWF 0, and JIO flSl . 
The SG type algorithm can be employed in these schemes to 
estimate w. However, it is difficult to set the step size for the 
existing methods to achieve a satisfactory tradeoff between the 
fast convergence and the misadjustment in dynamic scenarios. 
Besides, the generation of the projection matrix is still a 
complicated task that increases the computational cost. 

III. Proposed Reduced-rank SMF Algorithm 

In this section, we introduce a new adaptive reduced-rank 
algorithm based on the JIO scheme and employ the SMF 
technique with the time-varying bound to realize the data- 
selective updates for the beamformer design. It should be 
remarked that the JIO scheme is selected here due to its 
improved performance and relatively simple implementation 
over the AVF and the MSWF ones lfT4l . 

A. Proposed Set-Membership Scheme 

In the existing full-rank SMF scheme [T7l-[?], the filter 
w is designed to achieve a predetermined or time-varying 
bound on the magnitude of the estimation error (or the array 
output). This bound can be regarded as a constraint on the 
filter design, which performs the updates for certain received 
data, namely, the data-selective updates. For the reduced-rank 
JIO scheme with the SMF technique, we need to take both 
the projection matrix Tr and the reduced-rank weight vector 
w into consideration due to the feature of their joint iterative 
exchange of information. Let 8(i) represent the set containing 
all the pairs of {Tr(i), ■u>(i)} for which the corresponding 
array output at time instant i is upper bounded in magnitude 
by a time-varying bound 6{i), yields. 



n 

(so(i).ii!(i)) 6S 



(7) 

where so(«) denotes the transmitted data of the desired user 
from 6*0, S is the set of all possible data pairs (so(i), x{i)), and 
the set is referred to as the feasibility set. The pairs of 
{Tr{i)Tw{i)} in the set satisfy the constraint < 
In practice, S cannot be traversed allover A larger space of 
the data pairs provided by the observations leads to a smaller 
feasibility set. That is, as the number of data pairs increases, 
there are fewer pairs of {Tr(i), ^(i)} that can be found to 
satisfy the constraint. Under this condition, we define the exact 
membership sets ^'(i) to be the intersection of the constraint 
sets over the time instants i = 1, . . . , A^, i.e.. 



(8) 



where Ui = [w C''^\T^ G C™'''' : \y{i)\'^ < S^{i)} is the 
constraint set to provide information for the membership set 
to construct a set of solutions. It is clear that the feasibility 



set Q{i) is a limiting set of the exact membership set '^{i) in 
practice. The two sets will be equal if the data pairs traverse 
S completely. 

The proposed SMF scheme introduces the principle of set- 
membership into reduced-rank signal processing and inherits 
the advantage of the joint optimization between the projection 
matrix and the reduced-rank filter It updates the parameter 
vectors such that they will always belong to the feasibility set. 
Note that the time-varying bound 6{i) has to be chosen ap- 
propriately in order to devise an effective algorithm and avoid 
the risk of overbounding or underbounding. The selection of 
the bound will be given in the following part. 

B. Proposed Reduced-Rank SMF Algorithm 

In this section, we use the data-selective updates of the pro- 
posed SMF scheme in the reduced-rank JIO based algorithm. 
For the LCMV beamformer design, the proposed algorithm 
can be derived according to the minimization of the following 
cost function 

minimize E[\w"T^ x{i)\'^] 

subject to ■u;^a(6lo) = 7, and \w" T" x{i)\'^ ^ g'^ (i) , 

(9) 

where x{i) — x{i) is the reduced-rank received vector 
defined in (|5]i, a(0o) — a{9o) is the reduced-rank steering 
vector of the desired user, and g{i) is a coefficient that 
determines a set of estimates within the constraint set "Hi 
and \g{i)\ < S{i). The cost function in (|9]i depends on 
the projection matrix Tr and the reduced-rank filter w. The 
solution of (|9]l should be encompassed in the feasibility set in 
O and the pairs of {Tr{i),w{i)} should satisfy the constraint 
set n^^{w,Tr:\yii)\^ <d^t)}. 

In order to solve the optimization problem in (|9), using 
the method of Lagrange multipliers [4J and considering the 
constraint w^a{6Q) = 7, we have 

J{w,Tr) = E[w"T^x{i)x"{i)Trw\+2\Re[w"a{ea)~-f\ 

(10) 

where A is the Lagrange multiplier and Re[-] selects the real 
part of the quantity. Note that the constraint x{i)\'^ — 

g^{i) is not included in ( fTOl i. This is because a point estimate 
can be obtained from (fTOl i whereas the bounded constraint 
determines a set of {Tr^w}. We use the constraint with 
respect to a((?o) to determine one solution and to expand it to 
a hyperplane by using the bounded constraint. 

We use the SG type algorithm to update the parameter 
vectors. Specifically, assuming w is known, computing the 
instantaneous gradient of (fTOt with respect to Tr, equating it 
to a zero matrix and solving for A, we have 

Tr{i + 1) = T,(z) - /iT2/*(i) [I - a{ea)a"{eo)\x{i)w"{i), 

(11) 

where /i^ is the step size for the update of the projection 
matrix and I is the corresponding identity matrix. 

Assuming Tr is known, taking the instantaneous gradient 
of ( [Tol l with respect to w, equating it to a null vector and 



solving for A, we get 

w{^ + 1) = w{^) - - ~^^§^l^^]x{^) (12) 

where /i^B is the step size for the update of the reduced-rank 
weight vector 

The updates of the projection matrix and the reduced-rank 
weight vector may spend a long time or terminate suddenly 
due to the misadjustment if the step sizes cannot be set suit- 
ably. The second constraint in (|9]i can be used to set a bound 
on the power of the array output for adjusting the step size to 
avoid these problems. The predetermined bound [16 1, [17] in 
the SMF technique makes contributions to this topic. However, 
we cannot often determine the bound accurately since there is 
usually insufficient knowledge about the underlying system, 
especially when the scenario is changing. In such cases, a 
predetermined bound always has the risk of underbounding 
or overbounding, both of which result in the performance 
degradation. It motivates us to introduce a time-varying bound 
to circumvent the aforementioned problems. 

In the proposed algorithm, we use a time-varying bound 
in the second constraint of (|9]l to offer a good tradeoff 
between the convergence rate and the misadjustment by ad- 
justing the step size values automatically following the time 
instant. Under this condition, the update is performed only if 
the constraint \w^x{i)\'^ — g'^{i) cannot be satisfied. This 
scheme provides data-selective updates (updates with respect 
to certain snapshots) for the filter design and thus reduces the 
computational complexity compared with the existing reduced- 
rank algorithms (updates for all the snapshots). Specifically, 
by substituting the update equations of (flTT i and (flZt into the 
constraint on the time-varying bound, respectively, we obtain 



MT(i) 



and 



otherwise 

(13) 



Mi) 



^ aff (80)^(80)' ^ ' (14) 







otherwise. 



The only challenge left to us now is how to select the 
time-varying bound 6{i) in the constraint to make the pro- 
posed algorithm work effectively. We introduce a parameter- 
dependent bound (PDB) that was reported in |19| to update 
the reduced-rank weight vector for capturing the desired user 
and suppressing the interference and noise., that is 



5W=/3(5(z-l) + (!-/?) vHPvFMW^, (15) 

where /3 is a forgetting factor that should be set to guarantee 
an appropriate time-averaged estimate of the evolutions of the 
weight vector w{i), which is given by w{i) — Tr{i)w{i), 
\\Tr{i)w{i)\\'^a''^{i) is the variance of the inner product of 
the weight vector with n{i) that provides information on the 
evolution of w{i), a is a tuning coefficient with a > 1 1191 . 
and (T^(i) is an estimate of the noise power. This time-varying 
bound provides a smoother evolution of the weight vector 



TABLE I 

THE PROPOSED JIO-SM-SG ALGORITHM 



Initialization: 

T'r(l) ~ [Irxr Orx{m-r)] J 

w{i)-T?{l)a{9o)/{\\T?{l)a{eo)f)- 

fiT{l) and /itD(l) = small positive values. 

For each time instant i = 1, . . . , N 

x{i) = Ti^{i)x{i); y{i) = w" {{jxii); S{i) in 
if \y{i)f > S^(i) 

fJ-rii) in (13) 
Tr{i + l)m O 
a{eo)=T^{i)a{eo) 

fj,w{i) in GD 
+ 1) in Gill 

else 

Tr{i + 1) =Tr{i); w{i + l)='w{i) 

end 



trajectory and thus avoids too high or low values of the squared 
norm of w{i). 

Until now, we finish the derivation of the proposed al- 
gorithm, which is called JIO-SM-SG. A summary of the 
proposed method is given in Table |I] where the initialization 
procedure is important to start the update. From (ITTt and 
(fT2l l. the projection matrix and the reduced-rank weight vector 
depend on each other, which provides an iterative exchange of 
information between each other and thus leads to an improved 
performance. The SMF technique is employed in the proposed 
algorithm and the time-varying bound is calculated with the 
incoming of the received vector. It encompasses the pairs 
of the filter design {Tr{i),w{i)} in the feasibility set 9(i) 
that satisfies the constraint < S'^{i). The filter updates 

are not performed for each time instant i but only when 
this constraint cannot reach (i.e., data-selective updates). The 
computational complexity is reduced significantly and the con- 
vergence rate is further increased compared with the existing 
reduced-rank methods. The proposed algorithm combines the 
positive features of the reduced-rank JIO scheme and time- 
varying based SMF technique for the implementation of the 
LCMV beamformer design. 

IV. Simulation Results 

We evaluate the performance of the proposed JIO-SM-SG 
algorithm and compared it with those of the existing methods, 
i.e., full-rank SG |4|, full-rank SG with SMF [08], AVF [S], 
MSWF-SG 19 1, and reduced-rank JIO-SG lEl. We assume 
that the DOA of the desired user is known by the receiver. 
In each experiment, a total of K = 1000 runs are caiTied 
out to obtain the curves. We use the BPSK and set the input 
SNR= 10 dB and INR= 30 dB. Simulations are performed 
by an ULA containing m — 64 sensor elements with half- 
wavelength interelement spacing. 

In Fig. [T] there are q ~ 25 users, including one desired 
user in the system. The step size values are initialized by 
^j,(l) = ^^(1) = 0.05. We set a = 22, /3 0.99, and 
the rank r = 5. This experiment exhibits that the output SINR 
values of the existing and the proposed algorithms increase 



to the steady-state as the increase of the snapshots (time 
index). The proposed algorithm shows faster convergence and 
better performance over the existing methods. The step size 
values are adapted to ensure the fast convergence rate without 
the risk of misadjustment for the proposed algorithm. Due 
to the data-selective updates, the proposed algorithm could 
reduce the computational load significantly as it only requires 
17.2% updates (172 updates for 1000 snapshots), which is 
significantly lower than those of the existing reduced-rank 
methods (normally 1000 updates for 1000 snapshots). 




Number of Snapshots 



Fig. 1. Output SINR versus the number of snapshots 

Fig.|2] which includes two experiments, shows the effective- 
ness of the proposed algorithm with the time-varying bound. 
The scenario is the same as that in Fig. [T] We compare the 
full-rank (Fig.|2](a)) and proposed (Fig.|2](b)) algorithms with 
the fixed and time-varying bounds, respectively. In Fig. |2](a), 
the one with the fixed bound S ^ l.Q shows better perfor- 
mance than that with the time-varying bound but increases 
the computational cost as a tradeoff (56.2%). The algorithms 
with higher (S — 1.5) or lower (S — 0.7) bounds exhibit 
worse convergence and steady-state performance. The same 
result can be found in Fig. |2](b) for the proposed algorithm. It 
indicates that the time-varying bound is capable of improving 
the performance of the proposed JIO-SM-SG algorithm, while 
realizing the data-selective updates to reduce the computation 
complexity. 

V. Conclusion 

In this paper, we employed the time-varying bound SMF 
technique in the reduced-rank JIO scheme and developed 
a new adaptive algorithm for the LCMV beamformer. The 
proposed algorithm retained the positive feature of the iter- 
ative exchange of information between the projection matrix 
and the reduced-rank weight vector, and used data-selective 
updates to adjust parameters that satisfy the constraints of the 
LCMV cost function. The variable step sizes in the proposed 
algorithm provided a way to circumvent the problem between 
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Fig. 2. Output SINR versus the number of snapshots for (a) full-rank SM 
SG algorithm; (b) JIO-SM-SG algorithm 

the convergence and misadjustment. It achieved superior per- 
formance, especially in large array scenarios, with relatively 
low complexity. 
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